Minimal Filtering Algorithms for Convolutional Neural Networks
نویسندگان
چکیده
In this paper, we present several resource-efficient algorithmic solutions regarding the fully parallel hardware implementation of basic filtering operation performed in convolutional layers convolution neural networks. fact, these operations calculate two inner products neighboring vectors formed by a sliding time window from current data stream with an impulse response M-tap finite filter. We used extension Winograd’s minimal method and applied it to develop hardware-oriented algorithms for implementing M = 3, 5, 7, 9, 11. A proposed each case gives approximately 30% savings number embedded multipliers compared naive calculation methods.
منابع مشابه
Minimal Effort Back Propagation for Convolutional Neural Networks
As traditional neural network consumes a significant amount of computing resources during back propagation, Sun et al. (2017) propose a simple yet effective technique to alleviate this problem. In this technique, only a small subset of the full gradients are computed to update the model parameters. In this paper we extend this technique into the Convolutional Neural Network(CNN) to reduce calcu...
متن کاملConvolutional Neural Networks on Graphs with Fast Localized Spectral Filtering
In this work, we are interested in generalizing convolutional neural networks (CNNs) from low-dimensional regular grids, where image, video and speech are represented, to high-dimensional irregular domains, such as social networks, brain connectomes or words’ embedding, represented by graphs. We present a formulation of CNNs in the context of spectral graph theory, which provides the necessary ...
متن کاملDecision Support System for Age-Related Macular Degeneration Using Convolutional Neural Networks
Introduction: Age-related macular degeneration (AMD) is one of the major causes of visual loss among the elderly. It causes degeneration of cells in the macula. Early diagnosis can be helpful in preventing blindness. Drusen are the initial symptoms of AMD. Since drusen have a wide variety, locating them in screening images is difficult and time-consuming. An automated digital fundus photography...
متن کاملCystoscopy Image Classication Using Deep Convolutional Neural Networks
In the past three decades, the use of smart methods in medical diagnostic systems has attractedthe attention of many researchers. However, no smart activity has been provided in the eld ofmedical image processing for diagnosis of bladder cancer through cystoscopy images despite the highprevalence in the world. In this paper, two well-known convolutional neural networks (CNNs) ...
متن کاملConvolutional Neural Networks
Several recent works have empirically observed that Convolutional Neural Nets (CNNs) are (approximately) invertible. To understand this approximate invertibility phenomenon and how to leverage it more effectively, we focus on a theoretical explanation and develop a mathematical model of sparse signal recovery that is consistent with CNNs with random weights. We give an exact connection to a par...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Studies in computational intelligence
سال: 2021
ISSN: ['1860-949X', '1860-9503']
DOI: https://doi.org/10.1007/978-3-030-74556-1_5